On first-order phase transition in microcanonical and canonical non-extensive systems 
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Two examples of Microcanonical Potts models, 2-dimensional nearest neighbor and mean field, 
are considered via exact enumeration of states and analytical asymptotic methods. In the interval 
of energies corresponding to a first order phase transition, both of these models exhibit a convex dip 
in the entropy vs energy plot and a region with negative specific heat within the dip. It is observed 
that in the nearest neighbor model the dip flattens and disappears as the lattice size grows, while 
in the mean field model the dip persists even in the limit of an infinite system. If formal transitions 
from microcanonical to canonical ensembles and back are performed for an infinite but non-extensive 
system , the convex dip in the microcanonical entropy plot disappears. 

PACS numbers: 05.70.Fh 64.10.+h 64.60.-i 82.60.Qr 
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I. INTRODUCTION 

Phase transitions in microcanonical ensembles (ME), particularly in finite systems or long-range interacting systems, 
which are both nonextensive, have recently become a major subject of theoretical and computational study 
Although a lot has been done, in this work we bring up some points which may not be easy to deduce from the 
literature. 

A distinct sign of a ME first-order phase transition is a convex "dip" § or "intruder" f§ in an otherwise concave 
entropy plot (Fig. 1). 
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Fig. 1. Sketch of typical microcanonical specific entropy s(e) as a function of the energy per particle e for a small system with 
a first-order phase transition A convex dip of the depth 5s can be observed between ei and ei. 

In the simple case of a system with a one-dimensional thermodynamic space, which is considered in this paper, a 
convex dip always includes an interval between two points of inflection |j| where a second derivative of the specific 
entropy is positive and the heat capacity is negative. The convex dip in the entropy plot corresponds to the states of a 
two-phase coexistence; these states are unstable in the canonical ensemble (CE) and can not be accessed by equilibrium 
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methods. On the contrary, in the microcanonical ensemble, by tuning the energy, a system can be "forced" into these 
canonically unstable two-phase coexistence states. Reasons for this are simple: coexisting phases are separated by a 
boundary which carries a certain entropic cost which is determined by the depth of the dip 6s. If a system is small 
or the interaction is long-range so that the interfacial region occupies a significant part of the total volume, this cost 
becomes important. Therefore if we put two weakly interacting small clusters that are allowed to exchange energy 
with each other into a state near the "bottom" of the dip, one of them will gain some energy and move close to the 
single-phase state 2, and and the other will lose some energy and move towards another single-phase state 1. As a 
result, the total entropy of two clusters will increase by ss 26s. If a system consisting of many such energy-exchanging 
clusters is put into a state where each cluster initially has energy between e\ and e2, most probably it will arrange 
itself so that some cluster will be in state e\ and the remaining ones in e%. This scenario was frequently observed 
in Monte-Carlo simulations of small Lennard- Jones clusters P,[To|], where the probability to find a cluster with an 
interface was very low. On the contrary, in the ME one can tune the energy of a single cluster to any state including 
those in the phase coexistence interval and therefore put a system into a state with an interface even if it is entropically 
unfavorable. 

Usually, as the system size increases and the contribution of the interface to the total entropy becomes negligible, 
the convex dip gets shallower and in the limit of infinite system size becomes a straight line. At this point phase 
coexistence states can be accessed by both ME and CE methods and two ensembles become equivalent. However, 
if the interaction potential of the system is sufficiently long-range (non-integrable at the large-r limit), the relative 
interface contribution does not disappear in the bulk limit. In this case a system with a first-order phase transition 
in the ME can exhibit an entirely different phenomenology than in the CE. For example, microcanonical gravitating 
systems may have regions with negative specific heat even in the infinite system size limit . Similar to the small 
cluster case, these states with negative specific heat can not be observed in the equilibrium CE since they are unstable. 

To illustrate both the short- and the long-range cases, we study the ferromagnetic g-state Potts model, defined by 
Hamiltonian (|l|). 



Two opposite limits are considered: Nearest Neighbor (NN) interaction as an example of a system with short-range 
interactions and the Mean Field (MF) theory as an example of a system with infinitely long-range interactions. In 
the first case, the sum in (Q) runs only over nearest neighbor spins, in the second case, it includes all spins present 
in the system. In the MF model it is customary to introduce a 1/N prefactor to make the total energy scale as ~ N 
in the N — > oo limit. With q > 4 for NN in 2 dimensions and q > 2 for MF, both of these models have first-order 
phase transitions |fL2[ . The q — 5 NN model is studied via an exact microcanonical transfer matrix enumeration on 
a two-dimensional square lattice of up to 6 x 6 sites. The q > 3 MF models are studied both by exact enumeration 
and continuous integration for a finite number of spins; an analytical asymptotics for s(e) is found in the infinite size 
limit. 

Given all the benefits of ME approach to first-order phase transitions outlined above, a natural question, "what 
can be learned about the ME properties from known CE behavior" arises. To address this question, we consider a 
typical example of a system with a convex entropy dip and perform a transition from ME to CE and back. It has 
been already stated S that usually the ME data allow a rather precise determination of all the CE properties but not 
the inverse. The reason for this is that the inverse Laplace transform, which is performed to obtain the ME entropy 
from the canonical free energy, is much less numerically stable than the direct one. Moreover, in the last section 
of this paper we show that it is impossible to recover any information about the ME entropy convex dip from the 
corresponding CE free energy if it is known only in the N — > oo limit. 



Let us consider a 2D Potts model on a square lattice of the size L x L. Since we are looking for signs of a first-order 
phase transition, we need to include into consideration at least the smallest possible value of q for which such a 
transition exists in the bulk limit: q = 5 A microcanonical transfer matrix method developed by Binder E| is 
used. Cylindrical boundary conditions with open bonds at the top and the bottom are utilized, a choice that will be 
justified below. We first enumerate all possible states \i), i — 1, . . . , q L of a single 1-dimensional ring of spins, calculate 
their energies Ei , and define a transfer matrix T with the elements T]y equal to the energy of all bonds between two 
adjacent ID rings of spins that are in \i) and \j) states. Then we define the degeneracy Dj(E) of a state \i) with 
the energy Ei of a ID spin ring, Dj(E) = 6E.Ei- The degeneracy of state with the energy E of a lattice consisting 
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II. EXACT ENUMERATION OF STATES FOR 2D POTTS MODEL 
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of a stack of n rings where the state of the top ring is i and the states of all lower rings are summed over, can be 
recursively expressed: 

D?(E) =Y,D?-\E>)6 E , E , +Ej+Tji . (2) 
We apply formula (|2|) N — 1 times and finally obtain for the degeneracy of the whole lattice 

D(E) ="£d?(E). (3) 

i=l 

This approach allows us to reduce the number of operations to ~ L 2 q 2L compared to ~ q L as for a straightforward 
exact enumeration. However it requires enough memory to store the transfer matrix which has q 2L elements. Applying 
a similar method to a system on a torus (with completely periodic boundary conditions) will require storing a 
degeneracy matrix Dfj(E) with 2L 2 q 2L elements and ~ L 2 q 3 L operations. Hence we chose to limit our considerations 
to systems with cylindrical boundary conditions, for which our computer resources allow us to study q = 5 spin 
systems on lattices with the base of the cylinder (length of the ring) up to 5. The main quantity we are looking 
at is the specific microcanonical entropy defined as the logarithm of the density of states fl(E) (which coincides 
with the degeneracy D(E) if the distance between energy levels is 1) divided by the number of spins N — L x L: 
s(E) = hi(£l(E))/N, with E being the total energy of the system For convenience we also use the intensive energy 
variable, energy per spin e = E/N. For the Hamiltonian (^) on the infinite 2D square lattice e varies between -2 and 
0. Plots of specific entropy s(e) as a function of e for various lattice sizes for q — 5 are presented in Figure 2; to be 
able to distinguish curves for different system sizes, we shifted plots for larger N upward. 
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Fig. 2. Specific microcanonical entropy s(e) = \n(Q(e))/N vs. energy per spin e for q = 5 for (top to the bottom) 7x5, 6x5, 
5x5, 4x4, and 3x3 lattices. A box is drawn around convex dips in all 5 curves. Ground states, which are separated from the 
first excited states by AE = 3 energy gap, are not shown in all curves. 

Systems of all sizes (even with N = 9 spins) exhibit definite signs of a phase transition: a dip between e w —1.7 and 
e w —1.2 can be clearly seen inside the box in all 5 plots. The dip gets shallower as N increases, which is consistent 
with reduction of the relative entropic cost of the interface for bigger systems. 

III. MF POTTS MODELS 

Let us consider next a Mean Field Potts (MFP) model defined by the Hamiltonian 
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Here 7Vj is a number of spins in the ith state, < < N, 1 < i < q. The coefficient — 2/(/V — 1), specific for a 2D 
square lattice, is introduced to make the MF Hamiltonian consistent with the exact one (Q): with this coefficient the 
energy per spin e in a perfectly ordered configuration is also equal to -2. One can view a MF model not only as an 
approximation to a real system, but also as an independent model with non-decaying infinitely-long interactions. It 
is known |L2| that in the canonical ensemble the MF has a first-order phase transition for q > 3 and a second-order 
for q = 2 (Mean Field Ising model). 

The microcanonical partition function of the MF Potts model can be expressed as 

N N /V' 

W(E) q ■ Sj* NitN 6^ Nl& . (5) 

Ni=0 iV 9 =0 11 «=1 *' 

Here E = —E(N - l)/2 + N (c.f. (g)) is a rescaled energy of the system. The two Kronecker S symbols are coming 
from the requirements that the total number of particles and the total energy are equal to N and E, respectively; the 
factorial ratio gives the statistical weight of the state. To calculate the partition function, for moderate N (N < 150) 
we perform an exact enumeration of states using integer arithmetics, while for larger N (150 < N < 600) we use 
rational number calculations. The results for the specific entropy s(e) are presented in Figure 3. 
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Fig. 3. Entropy s(e) vs. energy per spin e for q = 5 and N — 500 ( line) and q — 7 and TV = 100 (lower line). 

Since energy states with high and low degeneracies are often observed to be close to each other, these plots have a 
rather rugged structure. It naturally leads to the assumption that only high-degeneracy states contribute noticeably 
to a smooth coarsegrained entropy, which is defined as the logarithm of the sum of the statistical weights of a group 
of states with energies falling into a bin e — Ae/2, e + Ae/2. The size of the bin Ae must be large enough to include 
several energy states. Below we calculate the coarsegrained entropy and the leading term of its asymptotic behavior 
for N — > oo. 

After replacing sums by integrals, factorials by continuous functions via Stirling's formula, and introducing the 
intensive variables m = Ni/N, e = E/N 2 , Eq. (||) becomes: 

r 1 r 1 q q q 

W{£) w N q - 3 / . . . / d( V 7i, e) exp(-/V ^ m In m)dnx ...dn q (6) 

Jo Jo i=i i=i i=i 

Two integrations which eliminate the (^-functions are easily performed by introducing hyperspherical coordinates with 
the radius r = VzZl=i^i an< ^ ^ ne P°l ar ax is x \ — rcos(cf>i) along the g-dimensional vector (1/y/q, 1/^fq, ■ ■ ■ , 1/y/q). 
The Jacobian of this transformation is given by r 9_1 YliZi [ s * n (0i)] 9-1-1 (see, for example, 

W(e) w g(g - l/q) [JV2(e ~ ^ q)] V f eM-Nj2n l \nn l )f[8(n l )d q - 2 n 7 (7) 

J t=i i=i 

where 9(x) is the unit step function, and d q ~ 2 Vt is the remaining part of hyperspherical o — 1 dimensional angular 
differential after the polar angle <fii integration has been carried out. The integration in (M) runs over the remaining 
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angular variables in the first quadrant (only where all Hi are non-negative) and is performed numerically. For the 
simplest nontrivial case of q — 3, the above expression transforms to the following one-dimensional integral: (see 
Fig. 4) 




Fig. 4. Sketch of integration contour for (^) for 5 = 3 MF Potts model (3 solid lines segments). They lie on the intersection 
of a circle with center (-^=, -^=, -^=) and radius r = yje — 1/3 with the plane m +ri2 + fiz = 1. 
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(9) 



p=y/e-l/3. 



In the limit of AT — * 00 the integral (0) can be evaluated asymptotically for any q. With the restrictions JZi=i n « = 1 
and Jif = e, the function 53i=i ^jhini has g identical maxima at which one rii (say, ni) is large, and all the 

other m are the same: 



\ + ^{q~e-l){q-l) 



1- v/(ge-l)/( 9 -l) 



(10) 



To illustrate the dominance of the contributions from the maxima (|10[), we present in Fig. 5 a magnified segment 
of the plot of a non-coarsegrained (exact) s(e ) for q = 5 and AT = 500 from Fig. 3, together with a sequence of points 
ifiKi sk) that are the maxima defined by (JlCj)for integer A 7 ,: 
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where AT = N/q, N/q + 1, . . . , N labels the maxima. 
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Fig. 5. Entropy s(e) vs. energy per spin e for q = 5 and AT = 500 (solid line) and contribution from the states defined by 
Eq. §H§ (circles). 

Evaluating the integrals in (^) by the steepest descent method around the maxima (|Io|), we obtain for the specific 
entropy: 

s(e) = ln(W(e))/N = - Inn* + O(^). (12) 

Now we proceed by looking at signs of the convex dip in s(e) and associated with it an interval with positive second 
derivative s"(e), where the microcanonical specific heat C v = — (s'(e)) 2 /s"(e) is negative. Generally, a deviation of 
the s(e) plot from a straight line is hardly visible, so we present the results through the derivative s'(e). This is done 
for a twofold purpose: first, a sign of the second derivative can be easily deduced from the plots of s'(e); second, 
recalling the definition of the microcanonical inverse temperature /3(e) = s'(e), the s'(e) is of interest by itself. In 
Figure 6 we present the plot of s'(e) for the q = 3 MFP model for various numbers of spins N ranging from 50 to 
infinity. Curves for finite N are produced by direct numerical evaluation of the integral (^); knowledge of the N — > oo 
asymptotics ( p"^) h elps to avoid real number overflow for large N. The bottom line for N — oo is the exact steepest 
descent result (p^[) . 
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Fig. 6. Specific entropy derivative s'(e) vs. energy per spin e for q — 3 and for 10 various N (going from the up-most line 
down) N = 50, 100, 200, 400, 800, 1600, 3200, 6400, 12800, oo. 

For all system sizes N, s'(e) approaches the same value in the high-energy limit, s'(e = —2/3) = 3/4 (c.f. (||), 
(O). For any finite N, the second derivative of the entropy also approaches a finite negative value, s"(e) — ► —9/16, 
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as e — > —2/3, but the interval near e = —2/3, where s"(e) is negative, shrinks as 1/VN. 
In Figure 7, s'(e) is plotted for various q ranging between 2 and 100 for an infinite system. 
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Fig. 7. Entropy derivative s'(e) vs. energy per spin e for N = oo and for 7 values of g (going from the upper line down) 
q= 100,50,20, 10,5,3,2. 

For q — 2, which corresponds to the Ising mean-field model, s"(e) is negative for all allowed energies. This is 
consistent with the canonical ensemble results for the MF Potts q = 2 model, where the specific heat has finite limits 
on both sides of a second-order phase transition and experiences a discontinuous jump at the phase transition point. 
The microcanonical inverse temperature (3 = s'(e) at the point of phase transition e = — 1, which is the high end point 
of the allowed energy interval —2 < e < 2/q, is equal to its MF Potts canonical equivalent, (3 C = 1/2, given that the 
energy scale is defined as in the Hamiltonian (0). For q > 3, a region of positive s"(e) appears and gets wider with 
increasing q. At the upper boundary of the allowed energy interval, e = —2/q, the entropy derivative grows linearly 
with q, s'(e = -2/q) = q/4. 

Figures 6 and 7 indicate that MF Potts model does exhibit a convex dip in the entropy plot and an associated 
interval with negative specific heat, even in the infinite system limit. The reason for this is the distance-independent 
nature of interactions in the MF Hamiltonian which makes phase segregation impossible. Hence the entropic cost 
of phase coexistence scales linearly with the number of spins in the system and the depth of the convex dip in the 
entropy plot goes to a finite limit as N — > oo. 



IV. CONNECTION TO CANONICAL ENSEMBLE 



In the previous sections we performed a microcanonical analysis of the Potts model which is one of the most simple 
systems with a first-order phase transition. However, in general the canonical properties are much better studied than 
the microcanonical ones. A question then arises: what can be learned about the microcanonical behavior of a system 
which has a first-order phase transition from its canonical solution? A general answer is well-known: if a system 
is infinite and extensive, i.e. the interaction is not long-range, then microcanonical and canonical behavior are the 
same. However, the MF Potts model can be considered as having infinitely long-range interactions and, as we showed 
above, does have a negative specific heat even in the infinite system size limit. Below we present a description of 
what happens to the negative specific heat interval and the convex dip in the entropy plot as a whole, if we formally 
attempt a transformation from the microcanonical ensemble to the canonical ensemble (i.e. a Laplace transform of 
microcanonical partition function) and then transform back from the canonical to the microcanonical ensemble (i.e. 
inverse Laplace transform of the canonical partition function). This procedure discussed below is of a rather general 
nature and can be applied to any system with a convex dip in the microcanonical entropy plot; to the best of our 
knowledge, such a general description has yet not been presented in the literature. 

To calculate the canonical partition function Z(/3), 

Z{/3) — N f e N ^~^de, (13) 



7 



let us consider an interval of energies where the specific entropy s(e) has a convex dip (Fig. 8): 
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Fig. 8. Rescaled MFP entropy s(e) — 0.75e vs. energy e for q = 3 and N = 50 (black solid line). Straight lines j3e + a have 
slopes: ft = 0.7815, ft = 0.7615, and ft = 0.7715. 



For iV — ► oo, the integral (|13| ) can be evaluated by the saddle point method which yields for the specific canonical 
free energy /(ft 



1 s(V*l In TV 

/( « s -_H Z (ffl,=e--^ +0 (^), 



where e* = e*(ft) is the solution of equation 



S '(e*)=ft 



(14) 



(15) 



that maximizes the expression in the exponential of (|T^). For a concave entropy s(eh Eq. ( |l5| ) has not more than 
one solution. For a system where the entropy has a convex dip, for a certain ft Eq. (Hq) may have two solutions, e\ 
and e2- This is the case for all three (3 shown in Fig. 8. However, for both ft and ft a contribution from the second, 
smaller, maximum of s(e) — ft? to the integral ( p"3| ) is exponentially small in N. For example, for ft the left maximum 
ei is the global one, and 



/(ft) « ea 



s (ei) 
ft 



3 JV[( s (e 2 )- l 9ie 2 )-(s(ei)-/3iei)] 
AT ' 



(16) 



Only for (3 = 0*, do both maxima give equal contributions to /(ft); ft can then be identified with the inverse 
temperature of the first-order phase transition in the canonical ensemble. It follows from ( |l4| , p"5| ) that 



d[Pf(P)} 



dp 



0^/3* 



dP 



ei, 



d[Pf(P)} 



dp 



(17) 



which is in agreement with Ehrenfest's definition of a first-order phase transition. 

To put it another way, by performing the integration ( p"4| ) for various ft we sample s(e) for all e except for those 
inside a convex dip, and this sampling becomes a local one-to-one e — > P correspondence for infinite N . On the 
contrary, the contribution of a convex dip to /(ft) is exponentially (in N) suppressed and vanishes completely for 
N -> oo. 

Now we have arrived to where we usually start from: a canonical ensemble specific free energy /(ft) calculated in 
the N — > oo limit. It is a continuous function of P with a jump discontinuity in its first derivative at the first-order 
transition point ft. As we showed above, it contains no information about the behavior of s(e) in the interval where 
s(e) is convex. However, it is still worth finding out what kind of microcanonical entropy can be reconstructed from 
/(ft). In order to do that we perform an inverse Laplace transformation of /(ft): 



5(e) 



l,n(-L 



e+zoc 



3 AT/3[e-/(/3)] 



dP 



(18) 



8 



In the limit of N — > oo, we look for stationary points of the expression in the exponential, 0e — Bf(B). Since for 
8 ^ 8*, d[Bf(3)]/dd = e*(3), the extremum of the exponential is reached when e*(3) = e. Taking into account 
(|l4].|l5|), we obtain that s(e) = s(e). This is true for e < e\ and e > e 2 . Since f(3) has a cusp at = 0* and its left- 
and right- hand side derivatives are given by ©, the derivatives of 8{e - f{8)\ at 8 = 8* for e x < e < e2 are: 



d[/3e - /3/(/3)] 



dp 



= e — e 2 < 0, 



d[/?e - £/(/?)] 



f3=f3--0 



dp 



e x > 0. 



(19) 



/3=/3*+0 



Then for ei < e < e 2 , /?* gives the minimum of B[e — /(/?)] and in the saddle point approximation, integral ( |l8| ) is 
reduced to 



s(e) = 3*[e-f(3*)]+0( ] ^-) 



(20) 



From the definition of 3* (see Fig. 8) we have that 3*{e.\ — e 2 ) = s(ei) — s(e 2 ) and B*f{8*) = B*e\ — s(ei). Substituting 
this into (20), one obtains for ei < e < e 2 : 



5(e) 



e - ei 
e 2 - ei 



>(e 2 )-s(ei)] + s(ei) + 0( 



(21) 



So in a double transformed microcanonical entropy a convex dip is replaced by a straight line (marked B* in Fig. 8). 

For any sufficiently smooth and not too rapidly growing function, application of the direct and inverse Laplace 
transforms should leave this function unchanged. However, exact canonical solutions are almost never available for 
finite N; more often they are known in the infinite system limit which is singular. As was shown above, if the 
N — > oo limit is taken before the integral ( |l8| ) is evaluated, all information about a possible convex intruder in s(e) 
is totally lost. Assume we study /(/?) numerically for finite N. Still, our chances to recover information about a 
convex dip in s(e) via the inverse Laplace transform of the CE partition function are quite low even for modest N 
since the contribution of the convex dip to f(3) is exponentially small in N. In statistical terms, it can be rephrased 
as exponentially small accessibility of low statistical weight states to canonical random sampling. 

For extensive systems with first-order phase transitions, when the contribution of the interfacial states to s(e) 
disappears as N — > oo, a convex intruders flattens into a straight line. In this case a microcanonical behavior can be 
reconstructed from a known canonical solution via the procedure outlined above. In fact, this reconstruction can be 
made operating solely with intensive quantities f(0) and s(e) via what can be called a generalized Legendre transform: 



s(e)=/3 e e-8 e f(8 e ), 



d[Pf(B)} 



dB 



(22) 



The second equation can only be solved for e < e\ and e > e 2 . For ei < e < e 2 these two branches of s(e) are 
connected by a straight line (cf. (^l|)). 



V. CONCLUSION 



In two examples of the Potts model considered above, NN and MF, there is a convex dip in the entropy plot when 
the system size is finite. In the short-range-interacting NN model this dip flattens to a straight line as the system size 
tends to infinity, while the dip in the entropy of the infinitely-long- interacting MF model persists in this limit. This 
difference in behavior between NN and MF models is caused by different relative entropic cost of interfacial states 

d— 1 

which scales with the number of spins N as N~^~ in the locally interacting models such as NN and goes to a constant 
in the MF model. Since a convex dip in the microcanonical entropy is always associated with a negative specific heat 
interval, the corresponding states in the canonical ensemble are thermodynamically unstable and are not represented 
in the canonical free energy. Therefore in small or long-range interacting systems, these states of phase coexistence 
can only be studied in the framework of the microcanonical ensemble. 
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